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OVERVIEW 

© Distributed Parameter Modeling - PDEMOD 
® Wittrick-Williams Root Solving 
© Time Simulation Capability 

® Parameter Estimation Formulation 
© Modal Parameter 
© Time-Domain Data 

© Parameter Estimation Techniques 
© Lee and Hossain Approach 
© Modified Steepest Descent 

© Genetic Algorithm Approach 

© Examples - NASA Mini-Mast 

© Concluding Remarks 
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In this work, various parameter estimation techniques are investigated in the context of struc- 
tural system identification utilizing distributed parameter models and “measured time do- 
main data distributed parameter models are formulated using the PDEMOD so tware de- 
veloped by Taylor [1]. Enhancements made to PDEMOD tor this work include a 
Wittrick-Williams based root solving algorithm [2], (ii) a time simulation capability and (m) 
various parameter estimation algorithms. The parameter estimations schemes will be con- 
trasted using the NASA Mini-Mast as the focus structure. 
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PDEMOD- Partial Differential 
Equation MODeling 

Generic Configuration 

BEAM #3 


namm 


BEAM #2 


BEAM #1 

® 3 - Dimensional Spacecraft 

© Rigid Bodies (Full Inertia Matrices) 

@ Flexible Beams 

@ Bending - Euler-Bernoulli Equations 
® Elongation, Torsion - String Equation 

Force, Moment and Constraint Equations Yield 
Characteristic Equation 

A(w)| = 0 

Dimension of A = 12*Number of Beams 
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Partial Differential Equation Modelling (PDEMOD-Release 1) is capable of modeling com- 
pl ex flexible spacecraft which consist of a three-dimensional network of flexible beams and 
rigid bodies. Each beam has bending (Euler-Bernoulli) in two directions, torsion, and elon- 
gation degrees of freedom. The rigid bodies can be attached to the beam ends at any angle 
or body location. 1 he eigenvalues are determined by numerically solving for the values of 
frequencies which cause the determinant of a frequency-dependent matrix to become zero, 
eigenfunctions can then be calculated in closed-form at a finite number of specified points. 
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EXTENSIONS TO PDEMOD 

Wittrick- Williams Root Solving Capability 

» Determines Number of E-values in Given 
Frequency Range 

® Can Indicate Presence of Repeated Roots 

® Reduces Computational Burden When Used in 
Conjunction with Root-Solving Technique 

Time-Domain Simulation Capabilities 

® Outputs at Discrete Points Calculated From 
Modal Model 

• “Modal Initial Conditions” Determined From 
Initial Conditions Using Finely Discretized 
Eigenvectors 

© Closed-Form Modal Time Solutions Utilized 
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In addition to the time-domain based parameter estimation techniques two enhancements 
to PDEMOD- 1 have been made. The first enhancement is a Wittrick-Wilhams based roc t 
s olvStt enhancement to the bisection root-solving algorithm. Provided lower and upper ft e- 
• thpWiitrick Williams algorithm provides the number of frequencies that exis 

st m cture °A h nkT- d fme n stonal created.'physical initial 
conditions are transformed to modal initial conditions using the eigenfunctions and mass dis 
tributlorn^ a number of discrete points. It should 

the number of discrete points must be chosen relatively large . The modal time responses 
are then calculated in closed-form. The resulting physical time response at the sensor loca- 
tions can then be calculated. 
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PARAMETER ESTIMATION FORMULATION 


® Frequency Domain Formulation 


min J = ^ Wi(<y{ 


• . x2 

exp ~ ^ana ) + Hj [| Ue Xp - ui na | f 


Frequency 

Satisfaction 


Eigenfunction 

Satisfaction 


wrt physical design parameters 

® Many Sensitivity Formulations Omit Eigenfunction Satisfactioi 

® Weights W and H Allow For Engineering Judgement on 
Confidence of Measurements 


Time-Domain Formulation - This Study 

tf 


•sensor 


minj - Y W| (y'xp(t)-y!, na (t) dt 

i = 0 J ’ 

to 

wrt physical design parameters 


Dynamic Systems and Control Laboratory 
University of Florida 


Many sensitivity-based (and other) parameter estimation techniques are driven by the mis- 
match in analytical and “measured" modal properties. The parameter estimation problem 
is then to adjust the physical parameters of the system such that there is an improved match 
between measured and analytical modal properties, often times subject to various con- 
straints. An a ternate formulation is to work directly with time-history measurements and 
analytical predictions. I his is the approach investigated in this paper. 
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PARAMETER ESTIMATION TECHNIQUES 


Lee & Hossain - Time Domain 


„k+l _ 


= q- S 


dq 


q k - Vector of Design Parameters 
S k - Step Size Matrix (???) 

— - Gradient 

dq 


® Experience - Difficulty In Selecting Step Size Matrix 
(Lee & Hossain Provide No Insight Into Selection) 

® Motivated by CHORDS (SDRC), Vary Only One Variable 
With Corresponding Highest Gradient Value 

® Uses 1-D Line Search on Single Physical Variable 
® Disadvantage: Loses Significant Gradient Information 

® Genetic Algorithms 
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Three parameter estimation techniques are investigated in this paper. The first is that pro- 
posed by Lee & Hossain [3], In this work, the parameter ot physical P™P er “^«; a ^ 
tied based on eradient information. There was no discussion in Ret. 13] on how to select he 
sten-size matrix S k . Improper choice of S k was found to lead to divergence of the solut < 

S k to lame) or in minimal improvement (S k to small). Motivated from an optimization tech- 
nique utilized in the CHORDS software program, a simplified one-dimension line search 
"Sed In this approach, the variable with the highest sensitivity is chosen to be 
varied with all others held^onstant. The optimal step-size ot the one-dimensional search 
was calculated using a quadratic approximation. This approximation required an additional 
function evaluation. Finally, a Genetic Algorithm [4.5] approach was investigated. 
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GENETIC ALGORITHMS 

® Based on Darwin’s “Survival of the Fittest” Theories 

@ Shows Great Potential for 

® Multi-Modal Objective Functions 
© Discrete and/or Continuous Design Variables 
© Discontinuous Design Space 

® Works With a Coding of the Design Variables, 

Not the Design Variables Themselves 

® Searches From a Population of Designs, 

Not a Single Design Point 

© Uses Payoff (Objective Function) Information, 

Not Gradient Information 

© Uses Probabilistic Transition Rules, 

Not Deterministic Rules 
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Genetic algorithms (GA's), as introduced by Holland [4], are one form of directed random 
search. The form of direction is based on Darwin’s “survival of the fittest” theories. GA's 
are radically different from the more traditional design optimization techniques. GA’s work 
with a coding of the design variables, as opposed to working with the design variables directly. 
The search is conducted from a population of designs (i.e., from a large number of points 
in the design space), unlike the traditional algorithms which search from a single design point. 
1 he GA requires only objective function information, as opposed to gradient or other auxilia- 
ry information. Finally, the GA is based on probabilistic transition rules, as opposed to deter- 
ministic rules. These features allow the GA to attack problems with local— global minima, 
discontinuous design spaces and mixed variable problems, all in a single, consistent frame- 
work. 
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GA’s - ALGORITHM OVERVIEW 

Initial Population of Designs Created - Random or Heuristic 

Initial Population Allowed to “Evolve” Over Generations 

Conjecture - Evolution is the Best Compromise Between 
Determinism and Chance 

Motivation - GA’s are Robust Over a Wide Range 
of Problems 
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In G As, a finite number of candidate solutions or designs are randomly or heuristically gener- 
ated to create an initial population of designs. This initial population is then allowed to 
evolve over generations to produce new. and hopefully better designs. The basic conjecture 
behind GA's is that evolution is the best compromise between determinism and chance. I he 
basic motivation behind the development of GA's is that they are robust problem solvers for 
a wide class of problems. However, it should be noted that they are not as efficient as nonlin- 
ear optimization techniques over the class of problems which are ideally suited foi nonlinear 
optimization: namely continuous design variables with a continuous differentiable ummodal 

design space. 
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GENETIC ALGORITHM MODULES 


© Design Variables Coded as a q-Bit Binary Number 
® Continuous Variables Like A/D Converter 
© Discrete Variables Have Unique Binary Strings 
© A Population Member is Just a String of Design Variables 

© GA Evaluation - Level of Fitness Assigned to Each Member 
© Fitness Chosen to be Related to Objective Function 
© GA’s Maximize Fitness 


GA Selection - Determination of Which Individuals in 

Current Population Chosen to be Parents 

© Biased Towards More Fit Members 

^ember^ fitnessj 


© Proportional Bias - p(‘ 


‘) = 


npop 

^ fitnessj 

j= i 

GA Crossover - Transfer of Design Information From 
Parents to Prodigy 

GA Mutation - Low Probability Random Switch of Bits 
® Retains Design Information Over Entire Design Space 
© Aids Search For Global Optimal Solution 
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Each design variable is coded as a q~bit binary number. A continuous design variable is approximated by 2 c i dis- 
crete numbers between lower and upper bounds set ior the design variable. Discrete variables would each be 
assigneda unique binary string. Apopulation member is obtained by concatenating all design variables toobtain 
a single siring ol ones and zeros. Evaluation is the process of assigning a fitness measure to each member of the 
current population. Because GA’s attempt to maximize the fitness of each member, an objective function which 
is to be minimized must be converted into an equivalent maximization problem. Selection is biased towards the 
most lit members of the population. Therefore, designs which are better as viewed from the fitness function, 
and t here! ore the objective lunction. are more likely to be chosen as parents. Crossover is the process in which 
design information is transferred to the prodigy Irom the parents. Many crossover operators (I-point, 2-poinl, 
uniform) have been investigated. Mutation is a low probability random operation which may perturb the design 
represented by the prodigy. The operator works on a bit-by-bit basis and is governed by the probability of muta- 
tion. p ni . At each bit. a biased coin toss is used to determine whether the bit should be logically “NOTed". The 
mutation operator is used to retain design information over the entire domain of the design space during the 
evolutionary process. 
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GENETIC ALGORITHMS - SUMMARY 
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In the implementation of the G A shown above, the prodigies are produced until the number 
of prodigies created is equal to iipop. the population size. At that point, the current population 
of parents are discarded and the prodigies are in turn made parents which are capable of pro- 
ducing the next generation of prodigies. Thus, the production of n w prodigies can be viewed 
as the completion of one generation cycle in the evolutionary process. During this procedui e, 
it is possible that both the fitness of the most fit member and the average population fitness 
can be temporarily reduced during the evolutionary process. To overcome this, the concept 
of a steady-state G A was implemented. In a steady-state GA (SSGA), the fitness of the chil- 
dren after they have been mutated is evaluated. These fitness values are then compared to 
the fitness of the two least fit parents in the current population. If the mutated child s fitness 
is higher than the least fit member in the population, the child will replace that membei an 
will instantly become a candidate parent. To keep intact the concept of a generation, a gener- 
ation is defined to be complete when the number of children produced, but not necessarily 
accepted into the population, is equal to n pop . 
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The NASA Langley Research Center Mini-Mast is an eighteen bay truss structure cantile- 
vered at one end and free at the other. The bays are numbered one to eighteen starting with 
one at the cantilevered end. Discrete masses are located at bays ten and eighteen. Three 
different models of the Mini-Mast were created. The first model was a two beam PDEMOD 
resulting in a frequency matrix of dimension twenty-four. The second model, which was used 
m the parameter estimation algorithms, was a one beam PDEMOD whose tip mass was ad- 
justed to produce “good” agreement with the two beam model. The reduction in the frequen- 
cy matrix from twenty-four to twelve greatly reduces the computational burden. In addition, 
a 30 element FEM was created for comparison purposes. In all models, the single sensor 
output (position) was located at the tip (bay 18). 
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NASA MINIMAST - IC AND RESPONSE 

Initial Condition 


INITIAL DISPLACEMENT PROFILE 



Tip Time Response (2 mode summation) 


MEASURED" tip displacement 
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The above figures provide the initial displacement and resulting time-history used in the pa- 
rameter estimation scheme. The initial condition was selected such that multi-modal re- 
sponse was present. 
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he parameter estimation problem investigated is to minimize J with respect to El and p. In 
the above Figure, surface profiles of J are presented for the cases of t f = 1 and t f = 5 seconds. 
I he upper figures are mesh plots of J. The lower subfigures are contour plots of J vs the de- 
s.gn parameters From all figures, it is apparent that the function exhibits local minima and 
maxima. In addition, from the contour plots, it is evident that the “valley” is rippled, in that 
there are local minima in the valley. 
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PARAMETER ESTIMATION PROBLEM 


Contour Plot Expanded (tf=lsec) 

CONTOURS: INTEGRAL SQUARED ERROR 


o 


0.02 8 
1.3 


2.5 

El (lb-ft*ft) 


Steep/Shallow Walled Problem - similar to classic “Banana 
Valley Problem 

The “Valley” is Rippled 

Multi-Modal Function Space 

tf=5sec Case More Difficult Than lsec Case 
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The figure above is just an expanded view of the lower left figure of the previous slide. The 
o di a^ilution is marked by the “ + " symbol. From this, and the previous igure it is seen 
that the function has characteristics similar to Rosenbrocks “Banana Valley pr<>We.m l ie 
problem at hand has the characteristic steep walled/gentle gradient valley of the Banana 
Valley- Problem. The t, = 5sec case represents the more ditficult problem in that the walls 

are sleeper. 
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LEE & HOSSAIN APPROACH 


* Parameter Divergence (S 4 = diag(le5, 175): Large) 



30 40 M «0 70 



10 20 30 SO 


® Parameter Convergence To Local Minimum 
(S k = diag(le4, 95)) 




w 40 30 ao 70 
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THe a u b ° V r e L figUreS Sh ° W P arameter vaJ ue vs iteration number for the Lee & Hossain ap- 
proach. The upper figure corresponds to the case where the step-size matrix, S k has been 
chosen to be to large It is apparent that the parameter values are diverging and the actual 
pat followed by the design variables is uphill. The lower figure corresponds to the case that 
there is convergence to a local minima. In comparing the two mass/length plots, it is apparent 
that the case of choosing S k to large has caused the algorithm to miss the local minima. 
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LEE & HOSSAIN APPROACH (cont’d) 

Slower Convergence (S = diag(le2, 55)) 



Algorithm Performance Sensitive To Selection of S 
Convergence To Local Minima 
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In this figure the value of the step-size matrix was chosen to be lower than the previous case 
of convergence The algorithm converges to the same local minima but requires a greater 
nuXTof temtions. These slides indicate the sensitivity of the algorithm to step-size selec- 
tion. Lee & Hossain provide no indication of how to select S . Thus, this remains an unre 
solved research issue for this algorithm. 
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SIMPLIFIED 1-D SEARCH 


Convergence Criteria Set to — < le 12 


Convergence Histories For Four Different Starting Points 


Convergence Multiple Starting Points 


Starting Points - “o”; Converged Solution - “x” 

One Solution Converges to Global Optimal 
Starting/Converged Points 

(2.55e7, 0.01) gp> (2.55e7, 0.024) 

(2.9e7, 0.096) gp> (2.76e7, 0.1070) NOTE: OPTIMAL 
(2.9e7, 0.090) g£> (2.75e7, 0.077) NOTErClose to Previous Start 

(3.1e7, 0.150) iP> (2.875e7, 0.1370) 

Dynamic Systems and Control Laboratory ^ 

University of Florida • 


n the simplified 1-D search strategy, the variable with the corresponding highest gradient 

Thl^h A , q ™* atIC approximation technique is used to determine the optimal step-size 
he above plot shows the result of the algorithm for four different starting initial conditions 
I he starting points are indicated by the “os’ and the ending points by “x's”. Note that all 
starting points were in the valley. The stopping criteria used to halt the iterations was when 
maximum gradient was lower than approximate machine precision. One of the four start- 
ing points ended up near the global minima. However, another nearby starting point actually 
converged to a farther away local minima. ^ 
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GENETIC ALGORITHM SOLUTION - Case I 

Utilized Linear Ranking Scheme to Map Minimization 
of Integral Into Maximization Problem 

Random Initial Population Utilized for Case I 


Convergence History 


CONVERGENCE HISTORY 


Solid - Most Fit Design 
Dashed - Average Fitness 


GENERATION NUMBER 


Note Rapid Convergence: In reality, could stop at 
generations 
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The above fieure shows the convergence history of the Genetic Algorithm parameter eseima- 
The above g integral value of the most fit member of the popula- 

the dashed line represents the i ntegr h va| - 

ue of the average member of the population at any given generation. Almear ranking scheme 

'^gtSJaSSSSaSSSSSSS. 
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riiis and the next slides show the population migration as a function of generation number 
In the figures, the “o s” represent the location of the random, initial population. The “*s" 
represent the population members at the stated generation number and the “+" indicates 
the global minima. After only five generations, most of the members have migrated into the 

valley From generations, ten to fifty, it is seen that the migration of members is towards the 
global minima. ‘ 
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GA’s POPULATION MIGRATION 


© After 20 Generations 


POPULATION MIORATION: TWENTY GENERATIONS 


lermnoo Population 0 
ution 


0.1«L 

| o.uj- 

o.uf- 


© After 50 Generations 


POPULATION MIORATION: FIFTY GENERATIONS 
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GA POPULATION/CONTOURS 


Population At Generation 20 on Contour Plot 



All Members in the Valley Searching For Minima 
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The above figure superimposes the contour plot with the population location at generation 
numbei 20. Fiom this figure, it is clear that the search is now confined to the valley. 
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GA’s - CASE II 

Initial Population Forced to Low Values of El and q 
Convergence History 


CONVERGENCE HISTORY 



OENB RATION NUMBER 


Population Migration 

POPULA-nON MIGRATION : FIFTY GENERATIONS: RESTRICTED INITIAL POPULATION 


o - Initial Popul»tidn 
* - Fifty Generation Population 
+ - Optimal Solutkm 


Initial Population 




BI(lb-ft*ft) x 10 
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In the previous figures, the initial population was created randomly. Thus, initial 

members were possibly already in the valley. To truly judge the P e ^ rm ^;^ h e ^ n A va d ^ 
proach the initial population in this case was constrained to low values of both design vari- 
ables. In the lower figure, what appears as a solid dot is really all thirty initial members of 
the population. After 50 generations, it is obvious that the population has migrated into t e 
valley .The top figure indicates that the majority of the migration was accomplished in the 

first ten generations. 
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In Case III, the integral was evaluated over a five second interval. The upper plot shows an 
ovei lay of the contours, the initial population (same as in previous random case), and the final 
population after 20 generations. Again, the population has converged to the valley, but has 
not yet found the global optimal. In the lower figure, the initial population was constrained 
to have low values of El, and high values of p. AH thirty members are contained in the solid 
dot in the upper left corner of the figure. After 50 generations, all members are in the 
valley; however, they have not found the global minima. In fact, another 50 generations were 
run with minimal change in population location. This indicates that although the G A solution 
appears to perform better than gradient based algorithms for this particular cost function, 
it still can become trapped in local minima (although theoretically if the number of genera- 
tions goes to infinity the global minima will be found (by default)). 
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CONCLUDING REMARKS 

Parameter Estimation Schemes Utilizing Measured Time 
Domain Data and Distributed Parmeter Modelling 
Investigated 

“Enhancements” to PDEMOD Include Wittrick-Williams 
Root Solving and Time-History Simulation 


Demonstrated That “Simple” Time Domain Cost Functions 
Yield “Difficult” Function Spaces 

Need to Search For Improved Time Domain Cost 
Functions 

Gradient-Based Algorithms Experienced Difficulty With 
Local Minima and Divergence 

Genetic Algorithms Showed Promise In These Areas, But 
Used More Function Evaluations 

Note That Mismatch in Function Evaluations Is a Function 
of Number of Design Variables 


Increasing Number of Design 
Genetic Algorithms 


Variables Favors 
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In this work, parameter estimation schemes utilizing measured time domain data were investigated. I he models 
used were developed using the PDEMOD approach. Two enhancements to PDEMOD-1 were made m order 
,o develop the parameter estimation algorithms. The first (Wittrick-Williams) reduced the computational bur- 
den associated with solving for the structure eigenvalues. The second provided time-s.mulat.on capab.ht.es. 
It was shown by example that a "simple" time-domain cost function actually yielded a dilhcult Junction space 
for the parameter estimation algorithms. The function space was multi-modal and exhibited charactenst.cs simi- 
lar to the classic “Banana Valley" problem. The gradient-based algorithms experienced severe difficulty. In fact, 
it was difficult to find starting conditions for which either gradient algorithm converged to the optimal solution. 
Conversely, the GA approach appeared to perform well. However, the GA used a much greater number ol unc- 
tion evaluations. This would not be the case if there were a large number of design variables. For gradient based 
algorithms, the number of function evaluations per iteration increases approximately linearly with the number 
of design variables (i.e. each additional design variable requires a gradient calculation). However, recause . s 
do not require gradient calculations, the number of function evaluations per generat.on is independent ol the 

number of design variables. 
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